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1.  INTRODUCTION 


In  Jacobs  and  Lewis  (1978a)  a scheme  for  obtaining  a 
sequence  of  discrete  random  variables  with  first  order  Markov 
dependence  and  with  a given  marginal  distribution  is  presented. 

The  process  is  a Markov  chain  and  has  the  physical  and  correlation 
structure  of  a first  order  autoregressive  process.  In  this  paper 
we  extend  this  result  and  present  a scheme  for  obtaining  a 
stationary  sequence  of  discrete  random  variables  with  p-th  order 
Markov  dependence  and  having  a given  marginal  distribution.  The 

process  is  a p-th  order  Markov  chain  and  has  the  physical  and 

correlation  structure  of  a higher  order  autoregressive  process, 

i.e.  X depends  explicitly  on  X .,...,  X . As  with  the  models 
n n-i  n-p 

in  Jacobs  and  Lewis  (1978a)  the  process  is  specified  by  the 
stationary  marginal  distribution  of  Xn  and  several  other  chosen 
parameters  which,  independently  of  the  marginal  distribution, 
determine  the  correlation  structure. 

This  DAR(p)  process  is  defined  as  follows.  Let  {Y^}  be  a 
sequence  of  independent  identically  distributed  random  variables 
taking  values  in  E a discrete  subset  of  the  real  line  with 
distribution  it.  Let  {Vn}  be  a sequence  of  independent 
{0,l}-random  variables  with 

P{Vn  = 1}  = 1 ' p*vn  = 0}  = P 

for  0 <_  p < 1.  Let  (An)  be  a sequence  of  independent  random 
variables  taking  values  in  {l,2,...,p}  with  P{An  = i)  = »•  > 0, 
i = l,2,...,p  where  ou  = 1.  Put 
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(1.1) 


X = 
n 


V X * 
n n-A 


+ (1  - 


n 


V ) Y 
n n 


f°r  n — 1,2,...  . Then  {X^}  is  called  the  DAR(p)  process 
(discrete  autoregressive  process  of  order  p) . it  will  be  shown 
in  Section  3 that  it  is  possible  to  obtain  an  initial  distribution 
for  (X_p+1,  — , X1#  XQ)  which  makes  the  sequence  {Xn> 
stationary  with  marginal  distribution  tt. 

In  Section  2 we  will  study  the  correlational  structure 
of  the  stationary  DAR(p)  process,  obtaining  Yule-Walker  type 
equations  and  discussing  their  solution  for  the  DAR ( 2 ) and 
DAR ( 3 ) process. 

Section  3 discusses  the  asymptotic  properties  of  the 
DAR  (p)  process;  it  is  shown  that  the  process  is  <f>-mixing  in  the 
sense  of  Billingsley  (1968)  and  consequently  that,  with  the  usual 
definitions,  sample  means,  covariances  and  quantiles  converge 
almost  surely  and  are  asymptotically  normal. 

The  process  as  defined  at  (1.1)  has  the  property  that 
all  of  the  serial  correlations  r(k)  = corr(X  ,X  ),  k = +l,+2,.. 
are  greater  than  or  equal  to  zero.  This  problem  can  be  overcome 
quite  simply  if  tt  is  a symmetric  distribution.  The  process  then 
becomes  a full  analog  to  the  standard  linear  AR(p)  process  (see 
e.g..  Box  and  Jenkins,  1970).  A discussion  of  the  correlation 
properties  of  this  extended  DAR (p)  process  is  given.  When  tt  is 
not  symmetric  it  is  necessary  to  consider  schemes  such  as  coupling 
two  DAP (p)  processes  over  a bivariate  sequence  {Yn,  , where 
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3 

1 


1 


t 

l 


the  Y 's  and  Y''s  are  negatively  correlated.  Since  this  leads 
n n 

into  the  question  of  multivariate  DAR(p)  processes,  it  will  be 
explicated  elsewhere. 


2.  CORRELATIONAL  PROPERTIES 


Let  {Xn}  be  a stationary  DAR(p)  process  having  marginal 

distribution  it  and  parameters  p,  a^,  i - l,...,p,  and  let 

m = E ( Y ) = E(Xn).  From  (1.1)  it  follows  that  the  dependence  in 

the  DAR(p)  process  is  due  to  the  random  selection  procedure  by 

which  X chooses  one  of  the  Y,  ; k < n.  In  other  words  it  is 
n k 

possible  to  write  X as  a random  index  model  over  Y,  , k<  n, 

n k 

although  the  indexing  variables  for  each  n are  correlated.  To 
derive  the  correlation  structure  it  is  easier  to  work  with  the 
autoregressive  formulation  (1.1).  Note  that  with  probability 
potj,  Xn+^.  = xn+k__.  for  j = l,...,p.  This  observation  allows  one 
to  derive  Yule-Walker  equations  for  the  serial  correlations 
r(k)  = Corr (Xn+^ , Xn)  quite  simply.  For  example,  if  we  center 
the  xn's  to  give  X^  = Xn  - m,  then  multiplying  (1.1)  by  X^_^ 
and  taking  expectations 


r ( 1)  = E ( X ' X ' ) 

n n-1 


= E (X'  , V X'  K ) + 
n-1  n n-An 


= pa1r(0)  + pa2r(l) 


E (X'  . ( 1— V ) Y — m) 
n-1  n n 

+ • • • + par (p-1) . 

P 


Continuing  this  way,  the  complete  set  of  Yule-Walker 
equations  is  obtained: 
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(2.1) 

r (1)  = pct^r  (0) 

+ 

pa2r(  1) 

+ • • • + 

pot  r(p-l)  , 

fcr 

(2.2) 

r (2)  = pa^r (1) 

• • 

• • 

+ 

pa2r  (0) 

+ • • • + 

papr(p-2)  , 

(2.3) 

• • 

r (p)  = pa^r (p-1) 

+ 

pa2r (p-2) 

+ • • • + 

pot  r(0) 

IT 

and,  for  k >_  1 , 

(2.4)  r(p+k)  = pa-^rtp+k-l)  + pa2r(p+k-2)  + •••  + papr(k) 

Clearly,  when  p = 0 all  r(k)'s,  k = 1,2,...  are  zero,  so 

that  one  is  interested  in  solving  the  equations  for  0 < p < 1. 

To  see  that  the  serial  correlations  are  all  positive  or 

zero,  let  q(i)  be  the  probability  that  X and  X choose 

n n+i 

the  same  random  variable  Y,  , where,  because  of  the  backward 

k 

definition  of  the  autoregression,  k £ n.  Then  q(i)  also  satisfies 
equations  (2.1)-(2.4).  Hence  r(i)  = q(i),  i = 1,2,...  and  the 
correlations  for  the  DAR(p)  process  are  always  nonnegative. 

If  we  define  a generating  function 

oo 

3 (z)  = £ 7?  r(j)  for  0 < z , 

j=l 

then  from  (2.1)  - (2.4)  we  have  that 


1 


I 

tj 

; 


6 


# 


(2.5)  0(z) 


= {z[pa.r(0)  +•••+  pa  r(p-l)]  + z [pa,r(0)  + •••  + pa  r(p-2)] 
i p z p 

2 n l 

+ zp[pa  r(O)J)  {1  - zpa.  - z pa,-  *'*  -zppa  } 

P z p 


The  roots  of  the  characteristic  equation 


(2.6) 


. 2 Pa 

1 - zpa,  - z pa,  - ’ ’ * - zrpa  = 0 


can  be  used  to  expand  3(z)  by  partial  fractions  to  obtain  expres- 
sions for  r(k).  The  roots  can  also  be  used  to  characterize 
the  behavior  of  the  autoregressive  function  (r(k)}.  This  will  be 
illustrated  for  the  DAR ( 2 ) and  DAR ( 3)  processes. 

First  we  note  that  since  p and  the  a^’s  are  greater 
than  or  equal  to  zero,  the  left-hand  side  of  (2.6)  equals  1 at 
z = 0,  (1-p)  >0  at  z = 1,  and  since  it  is  monotone  in  z 
for  z _>  0 , there  is  one  and  only  one  positive  root  for  a value 
of  z > 1.  All  other  roots  are  negative  or  imaginary.  (For 
p = 1,  the  root  is  z\~  1/p*) 

Another  consequence  of  (2.6)  concerns  the  quantity  c 
defined  in  Jacobs  and  Lewis  (1978b) . We  have 

/ X.  +• • •+  X \ 

lim  m var  ( ) = var(X.  )c, 

m >00  V m / 1 


where 


c = 1 + 2 l r ( j ) 

j=l 
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The  inequality  follows  because  all  of  the  serial  correlations 
r(k)  are  nonnegative. 

Example  2.1.  The  DAR ( 2 ) process. 

In  the  definition  (1.1)  let  P{A  =1)  = 1 - P(A  =2}  = a 

n n 

for  0 <_  a <_  1 . If  a=l  the  DAR  (2)  process  reduces  to  the  DAR(l) 
process  which  was  studied  in  Jacobs  and  Lewis  (1978  a,b) . The 
Yule-Walker  equations  are  easily  solved  to  give 

(2.7)  r ( 1)  = pa  [ 1 - p(l-a)]-1 

and 

(2.8)  r (2 ) = (p(l-p)  + 2pa[p-l]Hl  - p(l-a)}  1 

= r (1)  [ ( 1 — p ) a-1  + 2p  - 1]  • 
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J 


If  a = 1,  r ( 1)  = p,  r (2 ) = p , ..  as  it  should  for  a 

first  order  Markov  chain;  if  a = 0,  then  r(l)  = 0,  r(2)  = p, 

2 

r(3)  = 0,  r(4)  = p , . To  obtain  possible  values  of  r(l) 

and  r(2)  note  that  from  (2.7) 


r(l)  (l-r(l))  1 = ap(l-p)  1 . 


Thus  for  fixed  r(l),  p must  be  greater  than  or  equal  to  r(l) 
since  0 < a < 1.  Further,  for  fixed  r(l)  and  p > r(l) 


(2.9) 


a = r ( 1)  [1  - r (1) ] -1  (1-p)  p-1  . 


Suppose  r ( 1)  is  fixed  and  p >_  r(l);  then  substituting  (2.9) 


into  (2.8)  yields 


r (2 ) = -r  (1)  + p [ 1 + r ( 1)  ] >_  r(l) 


It  now  follows  that  the  admissible  region  for  r(l)  and  r(2)  is 


1 > r (2)  > r (1)  . 


Note  that 


(2.10) 


r ( 1)  + r (2 ) _ 
1 + r(l)  f 


pa  = 


r ( 1)  [1  + r (2)  ] 


1 - r (1) 


Hence,  it  is  possible  to  obtain  estimates  for  p and  a from 
estimates  of  the  firfet  two  serial  correlations. 


9 


To  study  the  autoregressive  function  note  that  the 

characteristic  equation  (2.6)  becomes 

2 

1 - zpa  - z p ( 1-a)  = 0 

which  has  two  real  roots,  for  0 <_  a < 1, 

Z1  2 = ^P01  — a^-2Pd-a)} 

where 

a = [(pa)2  + 4p ( 1-a) ] 1/2  . 

2 1/2 

Since  a _>  [(pa)  ] = pa,  one  root  is  positive,  and  the  other 

is  negative.  Also  the  negative  root  is  dominant  in  absolute  value. 
Thus,  the  autocorrelation  function  for  the  DAR ( 2 ) process  is  non- 
negative and  is  a mixture  of  the  larger  inverse  of  the  positive 
root  decaying  geometrically  and  the  smaller  (in  absolute  value) 
inverse  of  the  negative  root  decaying  in  absolute  value 
geometrically  but  oscillating  in  sign  . Specifically, 

(2.12)  r (k)  = bxz“k  + b2z‘k 

for  b^  and  b2  given  as 

bl  = Zl1[1  ' Z22]  {(Z11  " z2L)(1  + z12z22)}"1 
b2  = z^d  - z~2)  {(z"1  - z2  L)  ( 1 + z-1z-2)}-1  . 

Eventually  the  larger  inverse  root  z2'*'  dominates  in  r(k)  and 
the  decay  is  geometric. 
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Example  2.2. 


The  DAR ( 3 ) process. 


P{A  =1}  = a.,  P{A  =2}  = a,,  P{A  =3}  = 1 - a.  - Ct- 
rl 1 n l n 12 

for  0 <_  a^,  0 <_  a2 » 0 <_  + a2  <_  1 • If  + c*2  = 1 then  the 

process  reduces  to  the  DAR ( 2 ) process.  The  Yule-Walker  equations 
become 

(2.13)  r(l)  = pa^  + pa2r(l)  + p(l  - a1  - a2)r(2); 

(2.14)  r(2)  = pa1r(l)  + pa2  + p(l  - - a2)r(l); 

(2.15)  r (3)  = pa^r (2 ) + pa2r(l)  + p (1  - - a2)  ; 

(2.16)  r(k)  = pa^r(k-2)  + pa2r(k-2)  + p(l  - - a2)r(k-3) 

for  k ^ 3.  Thus  from  (2.13)  and  (2.14) 

2 2 -1 
r(l)  = [pa^  + p (1-  - a2)a2J[l  - pa2  - p (1-  - a2 ) (1  - a2 ) ] ; 

r (2 ) = pa2  + p(l  -a2)r(l); 

and 

2 2 

r(3)  = p a^ot2  + p(l  - + (p  a1(l  - a2)  + pa2)r(l)  . 
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Since  equations  (2 . 13) - (2 . 16 ) are  linear  in  a|  = pa^,  = po^' 

and  p with  coefficients  involving  r(l),  r(2)  and  r(3),  they 
can  be  solved  for  and  p,  and  thus  for  and  p. 

To  facilitate  this  note  that  (2 . 13) - (2 . 15)  can  be  rewritten  as 

(2.13')  r ( 1)  = o^{l-  r (2)  } + a'[r(l)  - r (2 ) ] + pr(2); 

(2.14')  r (2)  = [1  ~ r ( 1) ] + pr(l); 

(2.15')  r (3)  = a{[r(2)  - 1]  + a£[r(l)  - 1]  + p . 


Hence  estimates  for  p,  a^,  and  can  be  obtained  from  the  usual 

estimates  of  the  serial  correlations  r(l),  r(2)  and  r(3). 
Problems  will  arise  in  solving  the  equations  (2 . 13 ' ) - (2 . 15 ' ) if  p 
is  close  to  zero,  since  when  p = 0 all  the  quantities  in  the 
equation  are  identically  zero. 

The  characteristic  equation  (2.6)  becomes 

(2.17)  0 = 1-  pa^z  - po^2 2 ~ p(l  - . 


Again  we  require  that  ^ 1>  so  that  the  process  does  not 

reduce  to  the  DAR12)  case.  To  find  the  roots  of  (2.17),  let 


27 


P (1  - 


1_ 

al 


12 


,2  3 

* _ b , a 

d - T + 27 


The  value  of  d can  be  either  positive  or  negative.  If  d > 0, 


equation  (2.17)  has  one  real  positive  root  and  two  imaginary 


roots  and  the  autocorrelation  function  will  have  a "damped  sine 


wave"  appearance,  but  the  function  will  eventually  decrease 


geometrically.  If  d < 0,  then  all  the  roots  of  the  cubic  are  real 


and  unequal , one  being  positive  and  greater  than  one,  the  other 


two  being  negative.  Hence  the  autocorrelation  function  is  a 


mixture  of  a geometrically  decreasing  term,  and  two  terms  which 


decrease  geometrically  in  absolute  value  but  oscillate  in  sign. 


Table  1 gives  values  for  the  first  nine  correlations  for  a 


DAR ( 3 ) process  with  p = 0.9  for  various  values  of  and  a2 . 


Example  2.3.  The  DAR(p)  process. 


The  Yule-Walker  equations  (2.1) -(2. 4)  can  be  reparametrized 


with  4>1  = pa1,  <J>2  = pa2,  . . . , <t>  = pa  , the  parameters  all  lying 


between  0 and  1,  with  the  constraint  that 


(2.18) 


0 <_  <J)^  + <j>2  + • • • + <j>  < 1 . 


Then  it  can  be  seen  that  the  Yule-Walker  equations  are  in  exactly 


the  same  form  as  those  given  for  the  usual  AR(p)  process  in  Box 


and  Jenkins  (1970,  p.  55).  The  parameter  space  for  the  DAR(p) 
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process  is  more  restricted  than  that  for  d>  in  the 

1 P 

AR  (p)  case,  but  the  solutions  are  the  same.  The  parameter  P 
does  not  appear  explicitly  in  this  parametrization;  however 
the  parametrization  is  useful  in  the  next  section  and  when 
negative  correlation  is  considered. 


3.  ASYMPTOTIC  PROPERTIES 

3.1.  Preliminaries;  Aperiodicity  and  the  Doeblin  Condition 

Let  {Xn)  t>e  a real-valued  DAR(p)  process  with  discrete  state 
space  E having  parameters  p and  (a.  ; i = l,2,...,p]  and  with 
distribution  tt  for  the  error  sequence  Yfi.  From  the  definition 

(1.1)  it  follows  that  Zn  = (Xn,  Xn+1,  ...  , xn+p_;L)  is  a 

Markov  chain  having  state  space  F which  is  the  pth-order  product 
space  of  E with  itself.  Let  P denote  the  transition  matrix 
of  { Z } . Then  for  i,  k € F , k = (k.,...,k  ),  i = (inf...,  i ) 

(3.1)  P (i  ,k)  > (l-p)p  irtk.)***  ir(k  ) . 

^ — x p 

For  C a subset  of  F let 

U (C)  = l tt  ( k i ) •••  tt  (k  ) = l U(k)  . 

k€C  ± p k€C 

The  asymptotic  theory  for  DAR(p)  processes  is  based  on  the  follow- 
ing result. 

PROPOSITION  (3.1).  The  Markov  chain  {Z^}  is  aperiodic  and 
satisfies  the  Doeblin  hypothesis  D as  generalized  by  Doob 
[p.  192,  [1953]]. 
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PROOF.  Fix  a subset  C of  F such  that 


<5  = inf  y(k)  > 0 . 

kec 


Let  A be  a subset  of  F with  y (A)  < y(C)/2.  Then 


P (i,  A n C) 


l 


P (i  ,k) 


k€ACnC  M 


TFT 


y (k) 


> l (1  -p)p  y (k) 

k€A  nc 


= (1-P)p  y(Ac  n C) 

> (l-p)p  y(C)/2 

> (1-p) p6/2  , 


since  y(A)  < y(C)/2.  Hence, 


(3.2)  P (i , A)  = 1 - P(i,  Ac) 


< 1 - P(i,  A n C) 

rKj 

< 1 - i (1  - p)2  6. 


The  result  now  follows. 

We  will  use  proposition  (3.1)  to  show  existence  of  a 
unique  limiting  distribution  for  and  to  show  that  the 
stationary  DAR(p)  process  is  4>-mixing. 
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3.2.  Stationarity  Conditions 

It  follows  from  Proposition  (3.1)  that  there  exists  a 
unique  limiting  distribution  v for  {Zn>  and  constants 

Y _>  ® and  3»  0 <_  8 < 1 such  that 

(3.3)  |pn(v,A)  - v(A)  | <_  yBn  » n = 1,2,  . . . 

for  all  subsets  A of  F (cf.  Doob  [1953,  p.  221]).  A 
stationary  DAR(p)  process  is  obtained  by  using  v as  the  initial 
distribution  for  (X_p+1,  X_p+2,  ...  , XQ).  To  see  that  v 
has  marginal  distribution  it,  let  {y  (j)»  j € E)  denote  the 
marginal  distribution  of  the  first  component  of  Z^  and  put 

Y ( j ) = limn^oo  Yn(j).  Note  that 

lim  y_  ( j ) = f pou  lim  Yn_±  ( j ) + d-p)  ^ ( j ) • 

n -+  °°  i=l  n -*■  00 

Hence,  y(j)  = PY(j)  + (1-p)  tt  ( j ) and  the  marginal  distribution 
of  the  stationary  DAR(p)  process  is  tt  as  asserted  in  Section  1. 

Example  3.1.  The  DAR ( 2 ) process. 

Let  {X  } be  a DAR ( 2 ) process  with  the  same  oarametr ization 
n 

as  in  Example  2.1.  If 

(3.4)  Y(s1/S2)  = lim  E [exp { -s1Xn+1  - s2Xn+_}]  , 

n 

and 

0(s1)  = lim  E [exp{-s1Xn) ] 
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then  Y(s^,s2)  satisfies  the  equation 


(3.5)  7(slfs2)  = (1— p)  3(s.,)  Ms,)  + paB  (sn  + s,)  + p(l-a)  yCs^s,) 


Solving  (3.5)  we  get 


» 2^/  M v 2 


1 2 ‘ 


12 


y(s1,s2)  = y (s, , s n ) = (1  - r(l))  B(s-,)  B(s0)  +r(l)  B(s.,  + s0) 


J2'~l 


1' 


’1  °2' 


and  inverting  the  transform  results  in 


(3.6)  v(i,j)  = lim  P{Xn+1=i ,Xn+2= j }= 


(1-r  (1)  ) tt  (i)  tt  ( j)  , 


r (1)  tt  ( j)  + (1-r  (1) ) 7t  ( j ) , i= j . 


where  r(l)  = ap{l  - p(l-a)}  = corr (Xn, X^+^)  in  the  stationary 

process.  Note  that  Ij€E  v(i,j)  = Ij^E  Wj,i)  = tt ( i ) , as  expected. 

In  simulating  a random  variable  with  distribution  v it  is 
simpler  to  use  the  conditional  distribution 


j {1  - r (1)  } tt  ( j)  , j ^ i , 

v(j|i)  = lim  P{Xn+2=j|Xn+1=i)  = . 

n °°  ( r ( 1)  + (1-r  (1)  ) tt  (i)  , j = i. 


Note  that  we  can  now  generate  a stationary  sequence  of  random 


variables  Xn,  n = 1,2, 


with  any  marginal  distribution  tt  and 


second-order  autoregressive  (AR(2))  correlation  structure.  From 
(3.6)  or  the  conditional  distribution  it  is  not  hard  to  show 


that,  with  m = e(y  ) = E(X  ) , 

n n'  ' 


(3.7) 

E [ X 1 

x i = 

n 

n-1 

(3.8) 

ElXn1 

Xn+1  = 

(3.9) 

VarfX  1 

x i = 

n 

n-1 

Directly 

from 

(1.1) 

we  ha 

(3.10) 

E [X  | 

1 X , 

= x . 

n 

n-1 

n-1 

= pax 

:n-l  + 1 

(3.11)  Var[Xnl 

x i 

n-1 

= Xn-1 

n+1' 


- { 1 - r ( 1)  } 2m2  - 2r  ( 1)  ( 1 - r ( 1)  ) 


mx 


n-l‘ 


= (1-p)  Var(Yn)  + pa ( 1-pa) x2  _n  J V-p(l-a)]x^ 

+ (1-p)  pE[Y2]  + 2p2a (1-a) xn_1xn 

+ 2p(l-p)m[ax  . + (l-a)x  ] . 

n-i  n 


The  regressions  (3.7)  and  (3.8)  might  suggest  that  the 
DAR ( 2)  process  is  time-reversible,  but  this  is  not  so.  To  see 
this,  note  that 
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Y (si,s2  ,s3}  = lim  E[exP{-slVl  - s2Xn+2  ' s3Xn+3}] 

n 00 

= paY(slfs2+s3)  + p(l-a)  y(s^+s3»s2) 

+ (1-p)  6(s3)  y , s2 ) 

Since  y^s^s^s.^)  f yts^s^s^)  it  follows  that  the  stationary 
DAR ( 2 ) process  is  not  time  reversible. 


Example  3.2.  The  DAR (3)  process. 

Let  { X } be  a DAR (3)  process  with  the  same  parametr ization 
n 

as  in  Example  (2.2).  As  before  let 

Y(s1,s2)  = lim  E [exp{ -SjXn+1  - s2Xn+2}]  , 

and  let 

B(s.)  = lim  E[exp{-s.X  }]; 

1 n + ~ 1 n 

6(s1,s2)  = lim  E [exp{-s1Xn_1  - s^^^}]; 

and 

r<sl's2's3>  ' ElexP('tslXn+l  - s2Xn+2  ‘ s3Xn+3)]  • 

Put  = pa^,  $2  - Pa2f  and  $3  = P(1  - - a2)  • Then,  from 

the  definition  (1.1),  and  accounting  for  the  possibility  of 

Xn+3  takin<?  values  Xn+2'  Xn+1'  Xn  or  Yn+3'  we  have 


21 


(3.14)  6(S;l,s2) 

= (1-p)  6 (s2)  + (p^y  (slfs2)  + (f>2y(s1  + s2)  + <}>3y  ( s2  , s^  . 

Solving  (3.13)  and  (3.14)  simultaneously  for  y(s1,s2)  and 
6 (si / s2 ) / it  follows  that 
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The  expression  (3.12)  can  now  be  used  to  obtain  an  expression 
for  T (s^s^s^  , and  substituting  back  into  (3.12)  we  get 


(3.16)  r(s1,s2,s3) 

= {l-cf^}-1  { (1-p)  [B  (s3 ) y (s1,s2)  + (f>33  (s2)  y (s3,s1) 

2 

+ 4)33(s1)y(s2,s3)  ] + 01[y(s1,s2  + s3)  + ct>3 y (s3  , s1  + s2  ) 
2 

+ {t)3^(s2^s3  + s1)]  + <t>2  [“Y  (s-l  + s3  , s2)  + 4>3y  (s3  + s2  , 

2 

+ <P3y  (s2  + slfs3)  ] } 

Note  that  r(si's2's3^  ^ r(s3,s2,s^)  in  general  and  hence  the 
stationary  DAR(3)  process  is  not  time  reversible. 

3.3.  Mixing  Results 

The  following  result  follows  directly  from  (3.3). 

PROPOSITION  3.2.  The  stationary  DAR(p)  process  is  <f>-mixinq  in 
the  sense  of  Billingsley  [1968]  with  c{)  ( k ) = yB*\ 
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This  last  result  implies  that  all  of  the  asymptotic 
results  in  Jacobs  and  Lewis  [1978b]  are  true  for  the  DAR(p) 
process  modulo  constants.  In  particular  the  usual  estimates 
of  covariances,  percentiles  and  quantiles  converge  almost  surely 
to  the  true  covariances,  percentiles  and  cruantiles  and  the  esti- 
mates are  asymptotically  normal.  Further,  a chi-square  goodness 
of  fit  test  can  be  obtained  for  the  marginal  distribution  of 
the  stationary  DAR(p)  process.  For  further  details  see  Jacobs 
and  Lewis  [1978b]. 


4.  EXTENSIONS 


One  possible  drawback  of  the  DAR(p)  process  as  defined 
in  (1.1)  is  that  all  of  the  correlations  are  positive . We  will 
now  discuss  a variation  of  the  DAR(p)  process  which  allows 

: 

negative  correlation  for  the  case  in  which  the  marginal  distri- 
bution n is  symmetric  about  zero.  The  case  of  nonsymmetric  n 
is  more  difficult  and  will  be  considered  elsewhere. 

Let  (V  },  {A  },  and  (Y  } be  as  in  Section  1 and 
n n n 

suppose  that  tt  is  symmetric  about  zero.  Let 


(4.1) 


X = V a.  X . + (1  - V )Y 

n n A n-A  n n 

n n 


where  (a^;  k = l,...,p)  is  a fixed  sequence  of  numbers  that 
are  either  -1  or  1. 

Rut  Zn  = (Xn,  Xn+1 Xn+p-l**  Then  {Zn}  is  a 

Markov  chain  with  a transition  matrix  P which  satisfies  (3.1). 
Thus  Propositions  (3.1)  and  (3.2)  still  hold,  as  well  as  (3.3). 

Let  (Xn)  be  a stationary  process  defined  by  the 
modified  DAR(p)  scheme  of  (4.1)  and  put  r(k)  = corr(Xn,  xn+jc)  • 
The  Yule-Walker  equations  for  this  process  are 
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(4.2) 

r (1)  = t>1 

+ 4>2r  (1) 

+ • • • + 

<P  r (p-1)  ; 

(4.3) 

r (2)  = ^rd) 

• • 

• • 

+ *2 

+ • • • + 

<t>  r (p-2 ) ; 

It 

(4.4) 

• • 

r(p)  = (J^rfp-l) 

+ 4>2r(p-2) 

+ • • • + 

<P  r (0)  ; 

(4.5)  r (p+k)  = <j>1r(p+k-l)  + <}>2r(p+k-2)  +•••+  (J)pr(k)  ; 


for  k >_  1 where  <J>k  = akP«k'  k = l,...,p. 

Equations  (4.2)- (4.4)  have  the  same  form  as  the  Yule- 
Walker  equation  on  page  55  of  Box  and  Jenkins  (1970)  but  the 
set  of  possible  values  of  4> ^ , i = l,...,p  is  more  restrictive. 
In  particular  we  always  have  that 

(4.6)  1 n I + l4>0l  +**•+  1 4>  | < 1 

12  p 


Example  4,1.  The  modified  DAR(l)  process, 

Let  = 1 and  a.  = -1.  Then 

n 1 


Xn+1  = -VlXn  + (1  ' Vn+l)Yn+l 


k k 

and  r(k)  = (-1)  p . If  a^=  1 the  process  is  the  same  as  that 
in  Section  1.  When  a^  = -1  the  modified  DAR(l)  process  is 
Markovian  with  transition  matrix 
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( (1-P)  TT(  j ) , * 

P(i.j)  - P(xn+1  - jlxn-1}  ' 

( P + (1-  p)  TT  ( j ) , -i  = j . 

Example  4.2.  The  modified  DAR (2 ) process. 

Let  P{ A = 1}  = 1 - P{A„  = 2}  = a , 0<a<l.  Solving 
n n — 

equations  (4,2)- (4.4)  we  obtain 

r (1)  = a^pa [1  - a2P  (1-a)  ] "~1, 

r (2)  = p[a2(l-a)  - p (1  - 2a)]  [1  - a2p(l-a)]-1  , 

and 

r (3 ) = p2a[2a1a2  (1-ot)  - a^d  - 2a)]  [1  - a2p(l-a)]-1  . 

Note  that  if  a1  = 1 (respectively  a1  = -1),  the  r(l)  > 0, 
(respectively  r(l)  < 0)  and  r(2)  can  be  either  positive  or 
negative.  The  analogue  of  the  characteristic  equation  (2.6)  is 

(4.6)  1 - a1paz  - a2p(l-a)z2  = 0 . 

If  a2  = 1,  then  (4.6)  has  two  real  roots;  if  a2  = -1,  then 
(4.6)  may  have  imaginary  roots.  Thus  the  autocorrelation 
function  can  either  have  a "damped  sine  wave"  appearance  or  be 
a mixture  of  terms  which  decrease  geometrically  in  absolute 
value  but  may  oscillate  in  sign. 
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M 


For  the  modified  DAR ( 2 ) process  the  range  of  values 
which  the  parameters  <J>^  and  can  take  is  not  as  broad 

as  for  the  AR2  case,  for  which  we  have  (Box  and  Jenkins 
[1970,  p.  58]) 

<t>2  + <J>i  < 

4>2  “ <f>2  < 

-1  < <P2  < 1 , 

which  allows  <|>^  to  range  between  -2  and  +2.  By  contrast  for 
the  modified  DAR (2)  (for  symmetric  distributions)  we  have 

I <t>2  I + I $1  I < If 

-1  < <P1  < 1, 

-1  < <J»2  < 1. 

Thus  we  have  a diamond  of  possible  values  in  the  (tf^,^) 
plane,  with  apexes  (0,1),  (1,0),  (0,-1),  (-1,0).  With 
this  restriction  the  behavior  of  the  serial  correlations  for 
the  modified  DAR (2)  process  is  the  same  as  the  behavior  for 
the  AR(2)  process  which  is  pictured  in  the  figure  in  Box 
and  Jenkins  (1970) . 

A limiting  stationary  distribution  can  be  derived  for 
this  modified  DAR (2)  process,  as  was  done  for  the  ordinary 
DAR (2)  process  in  Example  3.1. 
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